Analysis of data integrity and storage quality of a distributed storage system

CERN uses the world’s largest scientific computing grid, WLCG, for distributed data storage and processing. Monitoring of CPU resources is an important essential element to detect operational issues in its systems, example elements, ensure their proper efficient function. The processing experiment depends strongly on access quality, as well integrity both these key parameters must be assured lifetime. Given substantial amount data, O(200 PB), already collected by ALICE kept at various elements around globe, scanning every single chunk would a very expensive process, terms usage execution time. In this paper, we describe file crawler that addresses natural limits periodically extracting analyzing statistically significant samples files from evaluates results integrated with existing monitoring solution, MonALISA.